New M-estimators in semiparametric regression with errors in variables
نویسندگان
چکیده
In the regression model with errors in variables, we observe n i.i.d. copies of (Y, Z) satisfying Y = fθ0(X) + ξ and Z = X + ε involving independent and unobserved random variables X, ξ, ε plus a regression function fθ0, known up to some finite dimensional θ. The common densities of the Xi’s and of the ξi’s are unknown whereas the distribution of ε is completely known. We aim at estimating the parameter θ by using the observations (Y1, Z1), · · · , (Yn, Zn). We propose two estimation procedures based on the least square criterion S̃θ0,g(θ) = Eθ0,g[((Y −fθ(X))w(X)] where w is some weight function, to be chosen. In the first estimation procedure, w does not depend on θ and the distribution of the ξ’s is unknown. The second estimation procedure is based on Sθ0,g(θ) = Eθ0,g[((Y − fθ(X)) − σ ξ,2)wθ(X)] where wθ is positive weight function, to be chosen, and requires the knowledge of σ ξ,2 = Var(ξ). In both cases, we propose two estimators and derive upper bounds for the risk of those estimators, depending on the smoothness of the errors density pε and on the smoothness properties of w(x)fθ(x) or wθ(x)fθ(x) with respect to x. Furthermore we give sufficient conditions that ensure that the parametric rate of convergence is achieved. We provide practical recipes for the choice of w or wθ in the case of nonlinear regression functions which are smooth on pieces allowing to gain in the order of the rate of convergence, up to the parametric rate in some cases. 1 Université Paris X, Modal’X, 200, ave. de la République, 92001 Nanterre Cedex, France 2 Université Paris VI, PMA, 175, rue de Chevaleret, 75013 Paris, France ( [email protected]) 3 Université Paris Descartes, IUT de Paris, 143 ave. de Versailles, 75016 Paris, France 4 Université Paris-Sud, Bât. 425, Département de Mathématiques, 91405 Orsay Cedex, France ([email protected]) August 23, 2008
منابع مشابه
Generalized Ridge Regression Estimator in Semiparametric Regression Models
In the context of ridge regression, the estimation of ridge (shrinkage) parameter plays an important role in analyzing data. Many efforts have been put to develop skills and methods of computing shrinkage estimators for different full-parametric ridge regression approaches, using eigenvalues. However, the estimation of shrinkage parameter is neglected for semiparametric regression models. The m...
متن کاملWavelet Threshold Estimator of Semiparametric Regression Function with Correlated Errors
Wavelet analysis is one of the useful techniques in mathematics which is used much in statistics science recently. In this paper, in addition to introduce the wavelet transformation, the wavelet threshold estimation of semiparametric regression model with correlated errors with having Gaussian distribution is determined and the convergence ratio of estimator computed. To evaluate the wavelet th...
متن کاملRidge Stochastic Restricted Estimators in Semiparametric Linear Measurement Error Models
In this article we consider the stochastic restricted ridge estimation in semipara-metric linear models when the covariates are measured with additive errors. The development of penalized corrected likelihood method in such model is the basis for derivation of ridge estimates. The asymptotic normality of the resulting estimates are established. Also, necessary and sufficient condition...
متن کاملThe New Palgrave Dictionary of Economics Online semiparametric estimation
Semiparametric estimation methods are used for models which are partly parametric and partly nonparametric; typically the parametric part is an underlying regression function which is assumed to be linear in the observable explanatory variables, while the nonparametric component involves the distribution of the model's ‘error terms’. Semiparametric methods are particularly useful for limited de...
متن کاملDEPARTMENT OF ECONOMICS AND FINANCE COLLEGE OF BUSINESS AND ECONOMICS UNIVERSITY OF CANTERBURY CHRISTCHURCH, NEW ZEALAND Moment Restriction-based Econometric Methods: An Overview
Moment restriction-based econometric modelling is a broad class which includes the parametric, semiparametric and nonparametric approaches. Moments and conditional moments themselves are nonparametric quantities. If a model is specified in part up to some finite dimensional parameters, this will provide semiparametric estimates or tests. If we use the score to construct moment restrictions to e...
متن کاملWeighted and Two-stage Least Squares Estimation of Semiparametric Truncated Regression Models
This paper provides a root-n consistent, asymptotically normal weighted least squares estimator of the coefficients in a truncated regression model. The distribution of the errors is unknown and permits general forms of unknown heteroskedasticity. Also provided is an instrumental variables based two stage least squares estimator for this model, which can be used when some regressors are endogen...
متن کامل